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Abstract 



We present a computational model for Szilard's engine and the information 
discarding process. Taking advantage of a fact that the one is essentially the 
reversed cycle of the other, we can discuss the both by employing the same 
model. Through numerical simulations we calculate the work extracted by the 
engine and the heat generation in the information discarding process. It is 
found that these quantities depend on some realistic ingredients, which means 
that the work done by the engine is no longer canceled by the heat generation 
in the information erasure. 
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In 1876, Maxwell invented an external agent which utilizes information to extract the 
work from a single heat bath as a perpetual cycle [l|] . It is now known as Maxwell's demon. 
One of the simplest configurations related to Maxwell's demon was presented by Szilard 
@. It consists of one molecule captured in a cylinder in contact with a heat bath. The 
demon inserts the piston in the middle of the cylinder, observes which side the molecule is 
in, and then expand it to extract the work from the heat bath. After the expansion, the 
demon removes the piston and repeats the same manipulation. Based on some assumptions, 
Szilard showed that the work of fceTlog2 can be extracted per one cycle. This cycle seems 
to violate the second law of thermodynamics and has provoked many arguments among 
physicists since presented ||. 

Most of the physicists sought heat generation outside of the engine. In particular Bril- 
louin ||] studied concrete measurement processes and attempted to prove that such mea- 
surements should be accompanied by heat generation. Although his argument is attractive, 
one can always counterargue that there may be another measurement process without heat 
generation. Indeed Bennett suggested that reversible measurements are possible and pro- 
posed a new interpretation for the Maxwell's demon problem |J. His argument is as follows. 
For the total system to be a complete cycle, the information of the preceding cycle stored 
in the manipulator must be discarded before succeeding cycles. Following to the Landauer's 
claim, logically irreversible processes such as information erasure should be accompanied by 
heat generation at least fceTlog2 per bit 0. It might be plausible that the extracted work 
of fceT log 2 by utilizing 1-bit information is compensated by heat generation of 1-bit infor- 
mation erasure. Owing to their cancelation, the total system is expected to be consistent 
with the second law. 

While the above argument seems reasonable, we have some doubts about the evalua- 
tion of the extracted work by the engine and generated heat in memory erasure, because 
the thermodynamic nature of the information might depend on its physical embodiment. 
Especially the discussions so far are confined to idealized situation by means of thought ex- 
periments. In this Letter, we study energetics of computational models for Szilard's engine 
and information erasure by taking some realistic components into account. 

First, we present a computational model for Szilard's engine. Our model is one dimen- 
sional so that we can describe this system by a velocity and a position of the piston V, X 
and ones of the particle v,x. (See Fig. [[].) Let the mass of the particle and the piston be 
m and M, respectively. The position of the particle is restricted to the region — L < x < L, 
where L is the half length of the cylinder. We assume evolution equations for X and x as 



where £(t) is Gaussian white noise whose statistical properties are characterized by = 

and (£(£)£(£')) = 2(k B T5(t — t'). g(t) and f(t) are the momentum transfer per unit time 
from the particle to the heat bath and to the piston, respectively. 

g(t) is given implicitly by a stochastic rule at the boundaries x = ±L in such a way 
that the particle is reflected being assigned new velocity v at random with the probability 
distribution function 
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The distribution of the particle velocity turns out to be Maxwellian when there is only a 
single particle in the system fTj. Note that the piston is assumed not to undergo the reflection 
at the boundary. 

The form of f(t) is given on the assumption that the piston and the particle collide 
elastically. After a collision of the particle and the piston, they become 

v ' = TTi v + ITT"' < 4 > 

where e = m/M. Since the momentum transfer from the particle to the piston is 2m(v — 
V)/(l + e), we obtain 

/(*) = Ei^-(«-W-*«). ( 6 ) 

where 8(t) denotes Dirac's delta function and represents the time when z-th collision takes 
place. 

The demon manipulates the piston through a trapping potential U(x, t). We assume the 
form of the potential as 

U(X,t) = t(X-X (t)) 2 . (7) 
The form of Xo(t) is given as the demon's manipulation. In this paper, we assume 

r ±u/r (o < t < t) 

Xo(t) -\±l(2-t/r) (r<t <2r), (8) 

where the choice of the sign in the time interval < t < r depends on the relative position 
of the particle to the piston. (The sign is positive for X > x, while negative for x < X.) The 
sign of Xo(t) during r < t < 2r is determined so that Xo(t) becomes continuous. Further, 
the piston is assumed to be removed at t — r and to be reinserted at t — 2r. f(t) becomes 
zero during r <t < 2r, which means that the piston is outside of the cylinder. In this way, 
the demon can repeat cycles. The manipulation by the demon is shown in Fig. 0. 

Note that / can be larger value than L, because the piston can collide with the particle 
even if |Xo(t)| > L. Yet, since the difference of physical quantities such as work and heat 
between I = L and I > L is expected to be negligible when k is large enough to localize the 
piston, hereafter we let I = L. 

Next we present a computational model for a memory erasing process. We first notice 
that such a process can be designed as the reversed one of a Szilard's cycle. Initially, the 
piston is assumed to be in the middle of the cylinder. The particle is confined in one side 
(left or right) of it, which encodes an informational bit. After the piston is removed, it is 
reinserted in the left end of the cylinder and moved to the middle. The particle is now in 
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the right side. This operation turns out to be the reversed one of a Szilard's cycle as shown 
in Fig. ||, and to be a logically irreversible process to discard the information at the initial 
state (left or right) as shown in Fig Since we already have a computational model for 
Szilard cycles, we can easily realize the reversed Szilard cycle by employing the above model 
given by Eqs. ([I]) and (|2]). All assumptions are the same except for the manipulation of the 
piston such that 

X (t)-S ~ Lt l T (0 < ^ < ^) (q] 
Xo[t} -\L(t/r-2) (r<t<2r). (J) 

We also note that f(t) = when < t < r. 

We now discuss the energetics of our model. We first assume that the removement and 
the reinsertion of the piston cost no energy. The validity of this assumption can be proved by 
analyzing a suitable model for this process || . On this assumption, we study the energetics 
of Eqs. (HI) and (0). We follow the energetic interpretation for Langevin equations, which 
has been proposed by Sekimoto recently ||. By multiplying Eqs. ([!]) and (g) by V(t)dt and 
v(t)dt respectively and integrating over one cycle, we obtain 

' T MV(t)dV(t) + r dU l^ V(t)dt 



o w w Jo OX 
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[ (-Cv(t) + £(t) + f(tW(t)dt, (io) 

Jo 



2T mv{t)dv{t) = - [ T f(t)v(t)dt+ g(t)v(t)dt. (11) 
o Jo Jo 

These integrals are assumed as Stratonovich calculus for the following discussions being 
valid. We analyze Eq.(|T0"D first. The first term of the left-handed side is written as the 
kinetic energy difference denoted by AK = AMV 2 /2. We can rewrite the second term as 

JdU-J^^dt^AU + W, (12) 

where W is defined as 

which corresponds to the work done by the engine. 

The first two terms of the right-handed side of Eq. (|10D is denoted by —Qi, where Q± is 
interpreted to be the energy dissipation to the heat bath. The last term then corresponds 
to the energy gain from the particle, which is denoted by C, that is, 

C = £ f(t)V(t)dt. (14) 

Then, Eq. ( |10D becomes 

AK + AU + W = -Qi + C. (15) 
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Similarly, by analyzing Eq. ( pTTj) as we did for Eq. (fLOp, we obtain 

AK' = -C-Q 2 , (16) 

where Q2 = — J g(t)v(t)dt is the energy transfer from the particle to the heat bath and 
AK' is a kinetic energy increase of the particle. The total generated heat Q, the energy 
transferred from the system to the heat bath, is given by 

Q = Qi + Q 2 . (17) 

Using these notations, we have en energy conservation law 

AK + AK' + AU + W + Q = 0. (18) 

Note that this expression holds for each of succeeding cycles. By taking an average over 
many cycles, we obtain 

(W) + (Q) = 0. (19) 

In the argument below, () denotes the average over many cycles. 

Now we are ready to perform numerical simulations. We calculated the time evolution 
by a second order Runge-Kutta method. We let k^T = 1,M = 1, and L = 1 for non- 
dimensionization and hence dimensionless parameters are e, k, ( and r. We are particularly 
concerned with the e dependence of the work by the engine (W) e and the heat generation in 
the memory (Q) m . In Fig|| we plotted the result of simulations with the parameter values 
r = 10, k — 100 and £ = 0.1. For large e, the work and the heat generation goes below from 
/cbT 'log 2. It is also found that we get less work with smaller k. Our simulations suggest 
that the maximum work fcgT log 2 is obtainable in the limit of e — > 0, k —>■ 00 and r — > 00. 

These results show that the compensation does not occur unless we adopt exactly the 
same e for the engine and the memory. Moreover, total heat absorption in the engine cycle 
and the memory reset process is possible. Hence the interpretation of Maxwell's demon 
problem by Bennett and Landauer []5J is not applicable to this model. 

Furthermore, owing to the operationally inverse relation between the information erasure 
and the engine, we define the reversible heat generation (Q) rev and irreversible one (Q)i rr as 

(Qlev = i(Q)m ~ (Q)e)/2, (20) 
(Q)irr = ((Q)m+(Q)e)/2. (21) 

In Fig. |, (Q)rev and (Q)i rr were plotted against r while fixing the other parameter values 
as e = 10~ 4 , C = 1 an d k = 100. We found that (Q) rev and (Q)i rr are closed to ZcBTlog2 
and 2(/t, respectively. When the entropy production is defined through the irreversible 
heat generation, it becomes zero in the quasi-static limit. Do not confuse this fact with an 



incorrect statement that the heat generation during information erasure can be zero ||T0 
because the generated heat during logically irreversible processes has a positive reversible 
part. 

Here we address three remarks on our results. First, for generality of our results, we 
have studied another model where the single particle obeys the following equation instead 
ofEq. (|), 
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4 "-f^w -'<*>■ < 22 > 

where (£) = and (£(i)d£(t')) = 2(k B T5(t — £'). We confirmed that this model yields a 
qualitatively same graph as Fig. |[ 

Second, with some purturbative calculations, we get an analytic expression of the work 
done by the engine 

(W) e = ^k B T\og2-^, (23) 
1 + e t 

where we have assumed that e is small and k — > oo. Similarly, as to the heat generation in 
the information erasure process, 

{Q)m= l — 1 k B T\og2 + ^. (24) 
1 + e r 

These expressions are good agreement with the results of simulations where e < 0.03. 

Finally, we stress here the difference between our discussions and analysis recently pre- 



sented by Magnasco |TT| . His analysis is on the system described by a Fokker-Planck equation 
and applies to the automatic engine which needs no observer. It was proposed by Popper 
fi~2H as an objection to the notion that information is equivalent to negentropy (negative 
entropy) M. While the engine needs no observer (hence no memory), Magnasco showed 
that it cannot work as a perpetual cycle. His argument does not apply to the problem we 
discuss, since our system is assumed to be manipulated by the external agent which makes 
observation. 

In conclusion, we invent a concrete model for Szilard's engine. Numerical simulations 
show that its energy transformation ability from the heat to mechanical work depends on 
parameters, especially the mass ratio of the particle and the piston. We also find that an 
information erasure process need not cost k B T dog 2 energy in the same model. As to the 
Maxwell's demon problem, the work obtained is not canceled with the generated heat in the 
information discarding process. 

The arising question out of our results is on the consistency with the second law. As 
mentioned above, the interpretation of the Maxwell's demon problem does not hold on the 
assumptions we adopt, and hence the second law neither. As a plausible answer to the 
question, we conjecture that the excess heat is generated in the measurement process which 
transfers information from the engine to the memory. Even if a reversible measurement is 
possible, it may be realized only for particular devices. (In our case, e of the engine and 
the memory are precisely the same value.) When the embodiment of the information in the 
memory part is different from that of the engine part, the excess heat may be necessary in 
the information transferring process. These are future problems to be considered. 
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FIG. 1. Schematic figure of our model for Szilard's engine. 
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FIG. 2. Demon's manipulation of Szilard's engine. 



FIG. 3. Reversed operation of Szilard's engine. 



8 







FIG. 4. Schematic figure of information discarding process. 
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FIG. 5. (W) e (circles) and (Q) m (squares) versus e. These were obtained as averages over 5000 
cycles. 
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FIG. 6. (Q)rev (circles) and (Q)i rr (squares) versus r. The solid line is ksTlog2 and the dotted 
line is 2£/r. 
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